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METHOD FOR ENHANCING A THREE 
DIMENSIONAL IMAGE FROM A PLURALITY 

OF FRAMES OF FLASH LIDAR DATA 

CROSS-REFERENCE TO RELATED PATENT 5 
APPLICATIONS 

Pursuant to 35 U.S.C. §119, the benefit of priority from 
U.S. Provisional Patent Application Ser. No. 61/357,224, 
with a filing date of Jun. 22, 2010, is claimed for this non- 10 
provisional application. This application is also a continua- 
tion-in-part of and claims priority to U.S. patent application 
Ser. No. 13/046,030, filed on Mar. 11, 2011, which claims 
priority to U.S. Provisional Patent Application Ser. No. 
61/313,271, filed on Mar. 12, 2010. The contents of the fore- 15 
going applications are hereby incorporated by reference in 
their entireties. 

STATEMENT REGARDING FEDERALLY 
SPONSORED RESEARCH OR DEVELOPMENT 20 

The invention was made by employees of the United States 
Government and may be manufactured and used by or for the 
Government of the United States of America for governmen- 
tal purposes without the payment of any royalties thereon or 25 
therefore. 

FIELD OF THE INVENTION 

The present invention concerns a method for creating a 30 
Digital Elevation Map (“DEM”) from data generated by an 
apparatus relying on Light Detection and Ranging (“LI- 
DAR”) technology to generate the data. 

DESCRIPTION OF THE RELATED ART 35 

LIDAR is known for its ability to generate 2-dimensional 
(“2-D”) images of geographic surface features. 

In addition, flash LIDARs are able to generate, in real-time, 
range data that can be interpreted as a 3 -dimensional (“3-D”) 40 
image. Since the output from flash LIDARs includes range 
data, the output signals can be transformed into a correspond- 
ing DEM. 

Through theoretical and simulation analysis, it has been 
determined that a single frame or mosaic of flash LIDAR data 45 
may not be sufficient to build a landing site DEM with accept- 
able spatial resolution, precision, and size. 

A need, therefore, has developed for a method to provide 
additional enhancements, as set forth in greater detail below. 

50 

SUMMARY OF THE INVENTION 

It is one aspect of the present invention to provide an image 
processing technique, applicable to flash LIDAR data, to 
enhance the flash LIDAR data, permitting the generation of a 55 
DEM of sufficient quality and resolution to enable safe and 
precise spacecraft landings for robotic and/or crewed lunar 
and planetary missions. 

In another embodiment of the present invention, a super- 
resolution algorithm applicable to flash LIDAR range data 60 
that assists with the creation of a DEM with sufficient accu- 
racy, precision and size is disclosed. 

In yet another embodiment of the present invention, a 
super-resolution algorithm is disclosed which processes data 
generated during a series of simulation runs using a high 65 
fidelity model of flash LIDAR imaging of a high resolution 
synthetic lunar elevation map. 


2 

In still another embodiment of the present invention, the 
performance of flash LIDAR is disclosed. A flash LIDAR 
model was attached to a simulated spacecraft via a gimbal that 
pointed the LIDAR to a target landing site. For each simula- 
tion run, as the spacecraft descended to the landing site, a 
sequence of flash LIDAR frames was recorded and processed. 
Each run was provided with a different traj ectory profile, with 
varying LIDAR look angles of the terrain. 

In another embodiment of the present invention, the 
LIDAR frame output was processed using a super-resolution 
(“SR”) algorithm, which forms part of the present invention. 
The results of the analyses show that the level of accuracy and 
precision of the SR generated landing site DEM, with respect 
to detecting hazardous terrain features and identifying safe 
areas, offers an improvement over results available through 
available techniques. 

In yet another embodiment, the present invention also capi- 
talizes upon the ability to generate an optical offset between 
successive frames of flash LIDAR data. The offset may be 
provided as input for a system that provides guidance, navi- 
gation, and control of a vehicle, such as a spacecraft. It is, 
therefore, an aspect of the present invention to rely on flash 
LIDAR data for guidance, navigation, and control of a 
vehicle. 

In yet another embodiment, a real time identification of 
obstacles and measurement of collision time and trajectory 
profile for moving ground or air vehicles is provided. The 
present invention supplies 3-D images of surrounding envi- 
ronments and providing navigation data, unmanned or 
autonomous operation of ground and air vehicles. 

.Another embodiment of this invention is in a collision 
avoidance system for both manned and unmanned ground and 
air vehicles. By applying this invention to the Flash LIDAR 
data, obstacles, such as power lines, can be detected and its 
distance measured. 

It is also an aspect of the present invention to provide real 
time image enhancement of flash LIDAR data. 

These and other features, advantages, and objects of the 
present invention will be further understood and appreciated 
by those skilled in the art by reference to the following speci- 
fication, claims, and appended drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a perspective, schematic illustrating aspects of 
one embodiment of the present invention, illustrating a sur- 
face S to be measured by a single flash LIDAR detector pixel 
in the detector; 

FIG. 2 is a side view illustration of the schematic of FIG. 1, 
providing additional clarification of the variables identified; 

FIG. 3 graphically depicts the Average Residual data with 
respect to Frame Number for a first test case associated with 
the present invention; 

FIG. 4 graphically depicts the Standard Deviation of the 
Residual (Residual STD) data with respect to Frame Number 
for a first test case associated with the present invention; 

FIG. 5 graphically depicts the Correlation Coefficient data 
with respect to Frame Number for a first test case associated 
with the present invention; 

FIG. 6 graphically compares the Mean Residual data with 
respect to Frame Number for a second test case associated 
with the present invention; 

FIG. 7 graphically compares the Residual STD data with 
respect to Frame Number for a second test case associated 
with the present invention; 
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FIG. 8 graphically compares the Correlation Coefficient 
data with respect to Frame Number for a second test case 
associated with the present invention; 

FIG. 9 graphically depicts the Correlation Coefficient data 
with respect to Frame Number for a third test case associated 
with the present invention; 

FIG. 10 graphically depicts the Average Residual data with 
respect to Frame Number for a third test case associated with 
the present invention; 

FIG. 11 graphically depicts the Residual STD data with 
respect to Frame Number for a third test case associated with 
the present invention; 

FIG. 12 graphically depicts the Correlation Coefficient 
data with respect to Frame Number for a fourth test case 
associated with the present invention; 

FIG. 13 graphically depicts the Average Residual data with 
respect to Frame Number for a fourth test case associated with 
the present invention; 

FIG. 14 graphically depicts the Residual STD data with 
respect to Frame Number for a fourth test case associated with 
the present invention; 

FIGS. 15-16 provide a flow chart for a first method accord- 
ing to the present invention; 

FIG. 17 provides a schematic overview of one implemen- 
tation of the method depicted in FIGS. 15-16 on a vehicle, 
such as a spacecraft; 

FIGS. 18-20 provide a flow chart for a method according to 
the present invention; and 

FIG. 2 1 provides a flow chart for a method of enhancing the 
image or reducing noise of the elevation map produced with 
the back projection method according to the present inven- 
tion. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

The present invention is now described in connection with 
the generation of DEMs for extraterrestrial landings, i.e., 
lunar landings and landing on other bodies within the solar 
system. While discussed in this context, it is noted that the 
invention is not limited to extraterrestrial geography but may 
be employed for terrestrial mapping as well. Additionally, the 
present invention may be employed on any device, such as a 
robotic arm, that is guided using flash LIDAR data. Further- 
more, this invention can be employed for rendezvous and 
docking of spacecrafts, a spacecraft with a space station, and 
a spacecraft with a near-earth object such as asteroids. 

In addition, the present invention is described in connec- 
tion with one or more embodiments. The present invention, 
however, is not intended to be limited only to the embodi- 
ments described. To the contrary, those skilled in the art will 
readily appreciate that there are numerous equivalents and 
variations that may be employed consistently with the discus- 
sion of the present invention. Those equivalents and varia- 
tions are intended to be encompassed by the present inven- 
tion. 

With respect to the present invention, the tenn super-reso- 
lution (“SR”), as applied to image reconstruction (rather than 
optical diffraction limited SR techniques), generally refers to 
the group of signal processing algorithms that improve the 
spatial resolution of an image to better than the size of the 
pixel of the original image. The SR techniques and algorithms 
of the present invention are implemented by taking advantage 
of sub-pixel shifts between multiple, low-resolution images 
of the same scene. 

Historically, SR algorithms were developed for 2-D image 
processing. 


4 

As should be apparent to those skilled in the art, LIDAR 
imaging technology is capable of generating, in real-time, 
both 2-D intensity data and also range data. Together, the 2-D 
intensity data and the range data may be interpreted as a 3-D 
5 image. This dual aspect of LIDAR data underlies, at least in 
part, the present invention. 

Through theoretical and simulation analysis, it lias been 
determined that a single frame of flash LIDAR data may not 
be sufficient to build a landing site digital elevation map 
to (“DEM”) with acceptable spatial resolution, precision and 
size to meet current system requirements. 

In addition, existing technologies are not likely to be able to 
construct a DEM of sufficient quality and precision within the 
short time window available during a landing. During the 
15 landing of a vehicle, the total time available for processing 
data is quite brief. Existing technologies require processing 
that hinders or prevents the generation of a DEM of sufficient 
quality during the time period for spacecraft landing 

The present invention recognizes that the application of SR 
20 image enhancement techniques to flash LIDAR 3-D output 
images permits the generation of DEM with sufficient quality 
in a sufficiently short period of time to be useable by a space- 
craft during a landing procedure. 

To the extent that flash LIDAR enhancements have been 
25 addressed, flash LIDAR images are treated as a sequence of 
uncorrelated images. Moreover, the 3-D character of the data 
has not been exploited. As noted above, the 3-D character of 
the data includes, among other aspects, the 2-D intensity data 
and the range data inherent in the LIDAR output. 

30 The present invention encompasses an SR algorithm that is 
applied to flash LIDAR data, specifically the range data, 
permitting the creation, quickly and effectively, of a DEM 
with sufficient accuracy, precision and size. 

As a part of the development of the algorithm(s) applying 
35 SR to LIDAR data to create a DEM, the performance of the 
algorithm was analyzed by generating data from a high fidel- 
ity model of a flash LIDAR system containing parameters for 
various sensor functions and noise sources. The flash LIDAR 
model was embedded in a full end-to-end landing simulation 
40 device, which was attached to a gimbal on a spacecraft model . 
The spacecraft model was subjected to varying trajectories 
while “flying” to a mock lunar landing site. 

In the model, the gimbal on the spacecraft pointed the flash 
LIDAR to a target landing site throughout the trajectory of the 
45 spacecraft . During descent of the spacecraft, the flash LIDAR 
illuminated a high-resolution synthetic lunar elevation map, 
processed the returned laser light within the field of view of 
the sensor, and outputted the calculated sensor range data. 
The range images returned by the model were processed 
50 using the SR algorithm of the present invention and a landing 
site DEM was generated. 

The results of the modeling showed that the achieved level 
of accuracy and precision of the SR generated DEM was more 
than adequate for detecting hazardous terrain features and 
55 identifying safe areas. 

Flash LIDARs generally transmit a relatively wide diver- 
gence, pulsed laser beam that illuminates a target surface. The 
reflected laser light, together with any ambient light in the 
field of view (“FOV”) of the optical sensor, is received via an 
60 optical subsystem, is detected by a focal plane array (“FPA”), 
is translated into electrical signals by a readout integrated 
circuit (“ROIC”), and is timed and processed on a per pixel 
basis to generate time-of-flight range measurements. These 
range measurements can be interpreted as a 3-D image and 
65 transformed into a corresponding DEM. The relative intensi- 
ties of the returned signals are also measured and can be used 
to generate an intensity image. 
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In one example, the flash LIDAR system relies on a pulsed 
laser working at 1.5 micron (pm) wavelengths and a 128x128 
FPA. It is noted, however, that higher power lasers, operating 
at more responsive wavelengths (i.e., 1 .06 micron (pm)), and 
incorporating a larger 256x256 FPA and ROIC may be 
employed without departing from the scope of the present 
invention. In fact, it is anticipated that, as higher power sys- 
tems are developed, they will be employed in future systems 
embodying the present invention. 

One embodiment of the simulation environment that illus- 
trates the model context and interfaces of the present inven- 
tion as shown in FIG. 17 . The flash LIDAR model (i.e., the 
model spacecraft) interacts with a high resolution simulated 
lunar terrain via a mapping and ray trace routine. Multiple 
rays are assigned to each pixel within the FPA of the model. 
The ray-trace routine is used to interrogate the lunar terrain 
within the ground footprint of the sensor. 

A ground footprint is generated for both the transmitter and 
receiver from several parameters, such as the laser beam 
divergence, receiver FOV, and the model’s attitude and posi- 
tion, which are derived from the spacecraft slant range, path 
angle and gimbal orientation. Range and surface reflectivity 
data for each ray are returned to the core processing code of 
the model. 

Based on this input information, the model implements a 
standard convolution imaging equation, which is set forth 
below as Equation (1): 

X,(x,y,t)=p(x,y,n® $ (x,y,t)+i\(t) (1) 

In Equation (1), t, is the output signal, p is the point spread 
function that represents the LIDAR temporal pulse profile, 
9 is the object function that describes how the transmitter 
energy is scattered in amplitude and time, and t] is the total 
noise sum of various random processes such as detector dark 
noise. Johnson noise and shot noise. Range information is 
generated on a per pixel basis by signal reconstruction algo- 
rithms. The range data may be transformed into an angle- 
angle-range format and transferred to either a hazard detec- 
tion or hazard relative navigation algorithm. These 
algorithms produce maps that are fed into a guidance, navi- 
gation, and control (“GNC”) algorithm, which controls the 
motion of the spacecraft. 

The flash LIDAR model includes several parameters that 
can be adjusted to enable simulation of a wide variety of 
sensor specifications. Example parameters include, but are 
not limited to, instantaneous field of view (“IFOV”), receiver 
aperture, laser power, beam divergence, and sample rate. The 
parameters are loaded from an i-load file into the model 
before a simulation run and can be adjusted to enable a Monte 
Carlo-type simulation. 

The following steps are performed to setup and generate 
data to test the super-resolution algorithm of the present 
invention. 

First, a spacecraft trajectory was generated for 90° and 45° 
path angles with an initial slant range of 1000 m and a trajec- 
tory that descends linearly down to 100 m. In generating this 
trajectory, the following assumptions were made: the space- 
craft was assumed to move from the beginning to the end of its 
trajectory in 30 seconds and the frame rate of the LIDAR was 
20 Hz, effectively resulting in a new image being taken at 
every 1.5 m of descent. In this simulation, the gimbal was 
programmed to point at the target landing site throughout the 
trajectory except where random noise was injected on specific 
axes to test the SR algorithm. 

Second, an i-load file for the model was created with base- 
line sensor parameters. For example the FPA was set to 128x 
128 pixels and the range precision was set to 5 cm. The IFOV, 


receiver aperture, and transmitter beam divergence were 
adjusted during the descent as shown in Table 1 (below) to 
simulate zoom optics adjustments that may be made to keep 
roughly the same ground footprint throughout the trajectory. 

5 


TABLE 1 


Slant Range 
(m) 

IFOV 

(rads) 

Receiver 
Aperture (m) 

Transmitter Beam 
Divergence (rads) 

1000 

0.00040 

0.05 

0.0512 

750 

0.00053 

0.0375 

0.0678 

500 

0.00080 

0.025 

0.1024 

250 

0.00160 

0.0125 

0.2048 


15 Third, a synthetic lunar map with a 10 cm posting was 
loaded into the simulation as the representative landing site 
target for the spacecraft equipped with the LIDAR system. 
The map had an area of approximately 450x450 m, and 
minimum and maximum map height data of -9. 4 m and +4.87 
20 m respectively. After setup was complete, the simulation was 
executed and range output images were generated for each 
trigger point throughout the trajectory. 

The back project method underlying the present invention 
will now be discussed. The term “back projection” is com- 
25 monly used in the area of linear X-ray tomography in which 
the measured signals are 1 -D or 2-D projections of 2-D or 3-D 
objects, respectively. Calculation of the projections, i.e., solv- 
ing the direct problem, is performed by integrating an object 
quantity feature, for example density, along the X-ray path. 
30 Back projection, i.e., solving the inverse problem, occurs via 
a reconstruction technique where the properties of projec- 
tions are translated back into the object following the X-ray 
path in the inverse direction. 

The back projection method may be applied to flash 
35 LIDAR data. Using the back projection method for flash 
LIDAR data implies a model of the measuring process where 
the following is valid: the range recorded by a detector is the 
average of the ranges from the detector location to the each 
point on the reflecting surface, which is located inside of the 
40 detector FOV as described by the following equation: 


R i (,x l ,x 2 ) = llS i x If R{x, y)dx 
45 

where R, is the range recorded by detector pixel number i; 
R(x, y) is the range from the point with coordinates (x, y) on 
the surface, S„ to the detector; and Q, is the domain on the 
50 surface corresponding to the detector FOV. In fact, is the 
projection of the FOV on the flat plane, and S ; is the area of 
this domain as shown in FIGS. 1 and 2 . This model is an 
approximation, and the level of accuracy of this approxima- 
tion can be tested after the inverse problem is solved. 

55 The purpose of the SR method of the present invention is to 

determine elevations on a mesh with cells smaller than £2. If 
0 is defined as a rectangular mesh with pixel sizes that meet 
specified requirement, then Equation (2) can be rewritten as 
Equation (3), which is presented below: 

60 



65 

where k denotes the number of cells on the mesh 0 that 
overlap with the projection Q,, and Nj. is the number of such 
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cells. Equation (3) is a first approximation to Equation (2). 
Weighting factors may be included to increase the accuracy of 
the formula. The geometry of the back projection procedure is 
illustrated in FIGS. 1 and 2 . 

In one contemplated embodiment of the present invention, 
the algorithm is executed by performing the following steps: 

Step 1 : The SR elevation map is initialized as the fine mesh 
0. Then, arrays S, M and D are created. Arrays S(k) and M(k) 
are working arrays with dimensions the same as 0. Index k is 
a 3-D index into the fine mesh 0. Array D(h) contains the 
algorithm output — the elevation map on the fine mesh. All 
arrays are initialized to zero. 

Step 2: For each frame and for each individual detector of 
the FPA, the projection of the FOV on the reference surface 
(zero elevation level) is determined. 

Step 3: The set of cells from 0 that overlap with this 
projection are found. Using the center of the cell from 0 as 
one point, the one point is connected to the detector by a 
straight line and the distance is calculated. 

Step 4: The difference between the calculated distance and 
the range registered by the detector indicates the location of 
the point where the ray crosses the surface. The elevation of 
this point is calculated by the formula: 

*M=(^-^,)xsin e, (4) 

Points k and k x may be the same or different depending on the 
angle of incidence. 

Step 5: The arrays S and M are updated according to the 
following: 

M(i 1 )=M(*i)+ 1 (5) 

Step 6: This operation continues for all detectors in the 
current frame. Then, the following normalization procedure 
is applied: 

D(k)=S(k)/M(k) for all k (6) 

Step 7: Finally, steps two through six are repeated for all 
frames of the data. The DEM may be constructed after 
completion of these seven steps. 

Several computational experiments were performed to test 
the SR procedure of the present invention. These experiments 
focused primarily on construction of a DEM with sub-pixel 
resolution using data collected from various trajectories. All 
tests were performed using five basic steps: 

Step 1 : A simulated spacecraft trajectory and select a target 
map were generated. 

Step 2: The generation of flash LIDAR data (frames) 
throughout the trajectory was generated. 

Step 3: Controlled, random noise was added to all of the 
frames. 

Step 4: The back projection method was appliedto the data 
and the restored DEM was constructed. 

Step 5: Finally, the original “true” frames were compared 
with the constructed DEMs using basic statistical metrics. 
First Test Case 

In a first test case and in all subsequent test cases, the model 
of the flash LIDAR was used to generate the simulated 
LIDAR data. The original map was chosen from a synthetic 
lunar terrain database in POST II. The map was classified as 
a smooth mare terrain type with 10% rock abundance. The 
LIDAR input map was created from a portion of the original 
lunar map on a rectangular grid with 1024x1024 pixels. 
LIDAR data were generated using a nadir) (90° approach 
trajectory to this map starting with a slant range of 1000 m 
descending down to 100 m. The sizes of the frames were 
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128x128 pixels. Zoom optics were implemented, as previ- 
ously discussed, with zoom changes as shown in Table 1 . A 
low resolution DEM was generated using only the first frame 
of the data. 

5 The back proj ection algorithm of the present invention was 

then applied using the first 160 frames. Using the present 
invention, it was found that the restored high resolution map 
showed dramatically improved image quality. The results of 
changes in the mean residual, residual STD, and correlation 
111 coefficients for the maps are shown in FIGS. 3 , 4 , and 5 , 
respectively. As is apparent from these figures, minimal 
increases in image quality are gained after only a few frames 
of data. Convergence appears to have been reached after 
! . about 30 frames of data as illustrated by the asymptotic nature 
of the graphs provided. 

Second Test Case 

Fora second test case, the synthetic flash LIDAR data were 
generated using the same set of LIDAR parameters, optical 
20 zoom changes, and map that are discussed above in connec- 
tion with the First Test Case. The spacecraft trajectory also 
was the same except that a simulated jitter was injected onto 
the spacecraft by applying a normally distributed random 
variable with zero mean and a standard deviation of 0.1° 
25 (1 .745 mrads) along the spacecraft’s z-axis. 

The mean of the residual, standard deviation of residual, 
and correlation coefficient, all calculated between the true 
and restored maps are shown in FIGS. 6, 7, and 8. The results 
indicate a slight improvement in the performance of the SR 
11 1 algorithm of the present invention when jitter is applied to the 
flash LIDAR, and thus subsequent output data, than without 
jitter. This is due to the inherent nature of SR processing 
which takes advantage of any slight misalignment in corre- 
35 lated images. Thus, this type motion presents an advantage, 
since any real spacecraft will have some level of jitter during 
operation. 

Third Test Case 

In a third test case, the synthetic flash LIDAR data was 
40 generated using the same set of LIDAR parameters, optical 
zoom changes, and map that were used in the First Test Case. 
Simulated jitter was removed in this Third Test Case and a 
new, initial 45° incidence angle trajectory was flown by the 
simulated spacecraft. The spacecraft moved from =700 m 
45 down to 250 m in altitude (z-axis), while the slant range 
decreased from =1000 m down to 100 m. 

In this Third Test Case, the iteration interval used for pro- 
cessing was 50 frames. The correlation coefficient, mean 
residual, and standard deviation between the original and 
50 restored images are shown in FIGS. 9 , 10 , and 11 . The initial 
noise level on the ranges was =10 cm and the measurements 
contained a significant number of dropouts. After SR process- 
ing, the standard deviation of the residual between the origi- 
nal “true” map and the restored map was improved to =5 cm. 
55 Fourth Test Case 

In a fourth test case, the synthetic flash LIDAR data was 
generated using the same set of LIDAR parameters, optical 
zoom changes, and map that were used in the Second Test 
Case. The trajectory flown by the simulated spacecraft was 
60 modified to have a challenging 15° incidence angle. Again, 
the SR algorithm of the present invention was applied to the 
areas that were covered by the LIDAR footprint. The restored 
DEM, using iteration intervals of 1 and 50 frames, showed an 
increased image quality. Even for this shallow angle trajec- 
65 tory, the SR algorithm of the present invention provided sig- 
nificant improvement. The correlation coefficient, mean 
residual, and standard deviation between original and 
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restored images are for this Fourth Test Case are provided in 
FIGS. 12, 13, and 14. These statistics corroborate previous 
results. 

As discussed above, the present invention was imple- 
mented on a spacecraft model flying various, simulated, land- 
ing trajectories. The gimbal pointed the LIDAR to a target 
landing site throughout the trajectory. The flash LIDAR illu- 
minated a synthetic lunar terrain, processed the returned sig- 
nal with typical sensor noise characteristics, and output a 
range image which was subsequently processed by the SR 
algorithm of the present invention. Original, input maps to the 
LIDAR, and the processed SR maps were evaluated for visual 
quality and compared with basic statistical measures. 

The results show that the algorithm of the present invention 
improves the spatial resolution of noisy, low resolution flash 
LIDAR images and provides a high level of accuracy and 
precision in the final output DEMs . The present invention also 
proves to be robust when applied to different viewing angles. 
The present invention also may be implemented in real time 
using hardware processors. The production of high quality 
imagery and the potential for real-time implementation is a 
benefit of the present invention. Combined together with an 
ortho-rectification algorithm, and a hazard detection/hazard 
relative navigation algorithm, the SR algorithm of the present 
invention may be used to provide a critical component for 
performing autonomous and safe landings. 

The back projection method (SR algorithm) of the present 
invention will now be discussed in greater detail. 

FIG. 1 is a perspective schematic that illustrates the 
approach taken with respect to the present invention. A detec- 
tor 10 and an emitter 12 are shown. The detector 10 and the 
emitter 12 are understood to be integrated into a spacecraft, 
the details of which are not shown. As should be apparent, the 
present invention may be applied to any vehicle regardless of 
its construction. The emitter 12 emits laser light that is 
directed to a geographic surface 14. The geographic surface 
14, at least for purposes of discussion, represents a field of 
view of the detector 10 and also is a portion of a landscape, 
such as a lunar landscape. 

It is noted that the detector 10 tested as a part of the 
development of the present invention incorporated a detector 
10 with a 128x128 array of detector pixels, each of which are 
represented by the designation i. In other words, the detector 
incorporated 16,384 detector pixels. For purposes of the 
present invention, it may be said that the invention incorpo- 
rates a plurality of detectors i, each of which corresponds to an 
individual pixel in the detector array. The exact number of 
detector pixels i is not critical to operation of the present 
invention and any number maybe employed without depart- 
ing from the scope of the present invention. 

Light emitted from the emitter 12 reflects from the surface 
1 4 and, as reflected light 1 6, is detected by each of the detector 
pixels i in the detector 10. As should be apparent to those 
skilled in the art, the detector 10 may be any suitable type of 
detector that incorporates electronics capable of generating a 
two dimensional (or three dimensional) pixel map that repre- 
sents the data presented by the reflected light 1 6 . The detector 
10, therefore, may be any suitable type of photo detection 
device, as should be known to those skilled in the art. The 
output from the detector 10 is referred to herein as a frame of 
data. As should be apparent to those skilled in the art, a frame 
of data typically comprises a two dimensional array of digital 
data. The array of digital data may be rectangular, square, or 
any other suitable shape, as required or as desired. 

In the present invention, the frame of data includes range 
data R from the detector 10 to the surface 14 within the field 
of view of the detector 10. As should be apparent, for each 
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pixel i in the frame of LIDAR data, there will be an associated 
range R, between the detector 10 and the surface 14 for each 
detector pixel. 

In the context of the detector 10 discussed above, each 
5 pixel i in the data array will have a corresponding range 1 6, R, 
that is associated with a coordinate S, on the surface 14 that 
has been sampled. Alternatively, the ranges are referred to 
herein at R,. R, is used to abbreviate reference to any particu- 
lar pixel in the array, with the understanding that each pixel in 
to the array is given a unique number i that identifies the detector 
i associated with a specific geographic location (x, y) . In other 
words, the LIDAR frame of data will include i pixels, each of 
which corresponds to an area S, on the lunar surface (in this 
one example). “S” also is used to refer to the surface 14 for 
15 mathematical purposes. 

As further definitional background to the present inven- 
tion, and with continued reference to FIG. 1, an elevation map 
0 is defined. The elevation map 0 includes a number of cells 
k. The plurality of cells k define an array of values with AxB 
20 pixels. The array maybe square, such that A=B. Alternatively, 
the array may be rectangular such that A>B. Other variations 
also may be employed without departing from the scope of 
the present invention. In the context of the present invention, 
the mesh 0 was defined as an array of 1024x1024 pixels. As 
25 a result, for at least one embodiment of the present invention 
k»i (i.e., 1024 »1 28). 

As should be apparent from the foregoing, the number of 
pixels k may not be the same as the number of detectors i. 
There may be a larger or a fewer number of pixels k in the 
30 elevation map than there are detectors i that generate the flash 
frame of LIDAR data. Alternatively, there may be a larger 
number of areas S, than cells k in the map. Naturally, the 
number of areas S, for the surface 1 4 will correspond with the 
number of pixels i in the detector 10. 

35 Once the projection of flash LIDAR field of view on a 
projected flat plane 1 8 is defined, typically as a zero elevation, 
a range may be calculated from the projected flat plane 18 to 
the detector along a ray 20. The ray 20 is shown in FIG. 1 . The 
ray 20 is the distance from the detector pixel to the projected 
40 flat plane 18. As illustrated in FIG. 1, the range 16 from a 
detector pixel in the detector 10 to the surface 14 is the 
distance from the detector pixel to a first point 22 on the 
surface 14. The length of the ray 20 from the detector to the 
projected flat plane 18 is the calculated distance from the 
45 detector 10 to a second point 24 on the projected flat plane 18. 
As should be apparent, once the first point 22 and the second 
point 24 are defined, it is possible to calculate a distance 26 
between the first point 22 and the second point 24. This 
distance is referred to as a height h. The height h permits 
50 generation of the DEM. 

Having defined the variables, reference is now made to 
FIGS. 15-16, which illustrate the back projection method of 
the present invention for generation of a DEM for use on or 
with a vehicle such as a spacecraft. 

55 The back projection method 30 of the present invention 
will now be described in terms of various steps that are iden- 
tified in FIGS. 15-16. It is noted that the definition of the steps 
is not intended to be limiting of the present invention. One or 
more of the steps may be combined with others of the steps 
60 without departing from the scope of the present invention. In 
other words, the definition of a “step” is not intended to be 
limiting of the present invention. The use of steps is employed 
merely as an example of one contemplated embodiment of the 
present invention. 

65 As illustrated in FIG. 15, the back projection method, 
which permits the generation of a DEM of sufficient quality, 
starts at step 32. At step 34, light is emitted from an emitter 12 
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that is part of the flash LIDAR apparatus incorporated into the 
vehicle. The emitted light is directed to the surface 14. Light 
reflected from the surface 14 rettims to the detector 10. The 
reflected light travels along the ray 16 to the detector 10 and 
is detected by the detector pixels (also referred to as the 5 
detectors) i. At step 36, the reflected light is capttired by the 
detector pixels i in the detector 10. 

With respect to the method 30, it is noted that a single 
detector i is discussed. The detector i is intended to refer to a 
single detector pixel i or to the array of detector pixels i. io 
Discussion of the method 30 is made with respect to a single 
pixel, but it is to be understood that the discussion applies to 
the array of pixels as already noted. 

At step 38, a frame of data is generated from the captured 
light by the detector 10. The frame of data is a digital frame of 15 
data that includes, among other aspects of the surface S, a 
range R ( distance for each pixel i. While the contemplated 
embodiment relies upon a processor incorporated into the 
detector 10 to generate the frame of data, the processor need 
not be a part of the detector 10. To the contrary, the processor 
1 0 may be a component separate from the detector 1 0 without 2 0 
departing from the scope of the present invention. 

As noted the frame of data generated by the detector 10 
includes a rang 16, R,., which is measured as the distance from 
the detector 10 to a first point 22 on the surface S. As should 
be apparent, the range 16 will be a plurality of ranges R„ one 25 
for each pixel i. 

At step 40, an elevation map with a mesh 0 is defined. The 
mesh 0 typically will be defined by a processor associated 
with the detector 10. The mesh 0 includes a number of cells 
k. In one embodiment contemplated for the present invention, 30 
the cells k are arranged in a 1024x1024 array, as discussed 
above. 

Once the mesh 0, which is understood as a fine mesh, has 
been defined, the method 30 proceeds to step 42. In this step, 
three arrays are initialized. The three arrays are a first array 35 
S(k), which corresponds to the array for the surface 14, S, a 
second array M(k), which corresponds to a projected flat 
plane 18 for the mesh 0, and a third array D(k) that receives 
output and corresponds to the DEM generated from the frame 
data processed by the SR algorithm for the present invention. 

As noted, the value k corresponds to the cells k that make up 411 
the mesh 0. 

The method 30 then proceeds to step 44, where the surface 
14 is projected onto the mesh 0 that overlaps with the pro- 
jection. By this process, as should be apparent from the dis- 
cussion above, the array of i values that correspond to the 45 
number of detectors i are increased, at least in this embodi- 
ment, to an array of k values corresponding to the number of 
cells k in the mesh 0. 

At step 46, the set of cells k that overlap with the projection 
are selected. 50 

FIG. 15 includes a transition block A, labeled with the 
reference number 48, that provides a transition to the remain- 
der of the method 30 illustrated in FIG. 16. The transition 
block appears at the top of FIG. 16. 

With reference to FIG. 16, the method 30 continues to step 55 
50 where a second distance Rj. is calculated. The second 
distance or range Rj. is calculated as a distance from the 
second point 24 on the mesh 0 to the detector 10. This 
distance or range Rj. is labeled as the ray 20 in FIGS. 1 and 2, 
as identified above. 60 

Flaving established the ranges 16, R, and 20, Rj., the method 
30 proceeds to step 52 where the height h fa is calculated 
according to the equation: 

*K=(^i-^i)xsin 0, (4) 65 

The height h fa is identified as the line 26 in FIGS. 1 and 2 for 
clarity. The angle 0 is denoted in FIG. 2 
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The method then proceeds to step 54, where the first array 
S(k) and the second array M(k) are updated. This is done via 
the following equations: 

M(k l )=M(k l )+ 1 (5) 

As noted above, the first array S(k) and the second array M(k) 
were initialized to zero. Flaving processed the flash LIDAR 
data as discussed above, the values are now updated to incor- 
porate the calculated data. 

The method 30 then proceeds to step 56, where the third 
data array D(k) is normalized using the updated values for the 
first array S(k) and the second array M(k). 

The method 30 then ends at step 58. 

It is noted that the steps identified above represent one 
iteration of the sampling of frames of flash LIDAR data 
generated by the detector 10. As discussed above, if a larger 
number of frames of LIDAR data are employed, the accuracy 
of the DEM is increased. As noted above, it is anticipated that, 
if about 30 frames of LIDAR data are used, a DEM of suffi- 
cient quality can be produced. Since the detector 10 of this 
embodiment of the present invention operates at a frequency 
of 30 Hz, it is possible to create a DEM of sufficient quality 
from 30 frames of LIDAR data in one second, whichresults in 
the creation of a DEM in real time. As should be apparent to 
those skilled in the art, a larger or smaller number of frames of 
LIDAR data may be employed, as required or as desired. 

It is noted that the sampling rate of 30 Hz is merely the rate 
contemplated for one embodiment of the present invention. A 
larger or a smaller sampling rate may be employed without 
departing from the scope of the present invention. 

Reference is now made to FIG. 17. FIG. 17 provides a 
schematic overview of an operation diagram 60 of a vehicle 
according to the present invention. The flash LIDAR 62 of the 
present invention receives information about the terrain 64 in 
the manner discussed above, by emitting laser light and cap- 
ttiring reflected light from the terrain or surface 14. In addi- 
tion, the flash LIDAR apparatus 62 also receives sensor 
parameters 66 that include, but are not limited to, IFOV, 
receiver aperture, laser power, beam divergence, and sample 
rate. Other parameters that may be received include, but are 
not limited to, the vehicle’s attitude and position, which are 
derived from the spacecraft’s slant range, path angle and 
gimbal orientation. 

The data is then processed to transform the data, via the 
transformation processor 68 to generate the DEM. The DEM 
may then be provided to a hazard detection algorithm proces- 
sor 70 and the output may be provided to a guidance, naviga- 
tion, and control processor 72 that controls the operation of 
the vehicle. Separately, a visualization of the processors 74 
may be outputted . The visualization may be a digital elevation 
map or an equivalent for additional processing or generation 
of a visual representation of the surface terrain 14. The opera- 
tional schematic 60 illustrated in FIG. 17 provides a starting 
point to discuss at least a second aspect of the present inven- 
tion, which is directed to the navigation of a vehicle, such as 
a spacecraft, using the flash LIDAR data. 

It is recognized that the creation of a DEM is not required 
for operation of a vehicle such as a spacecraft. To the contrary, 
the data processed by the vehicle on a frame by frame basis 
can provide significant information for guiding and control- 
ling the vehicle even the absence of the generation of a DEM 
of sufficient quality. 

A general overview of the GNC of the vehicle will be 
provided before describing one embodiment of the method 
contemplated for the present invention. 
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As discussed above, the flash LIDAR apparatus generate 
frames of flash LIDAR data at a rate of 30 Hz, at least in one 
embodiment of the present invention. Therefore, each frame 
of LIDAR data has associated with it a predetermined time 
index of V 30 of a second. When subsequent frames of LIDAR 5 
data are correlated with one another, therefore, it is possible to 
appreciate the change between frames of LIDAR data for 
each time interval. This provides data concerning the speed 
and position of the vehicle with respect to a selected area (i.e., 10 
a reference area) on the surface 14. As a result, it becomes 
possible to generate parameters for input to a GNC processor 
for the vehicle to control the vehicle in its descent to the 
surface 14. In other words, the DEM does not need to be 
generated for input to the GNC processor. Instead, an offset 15 
(otherwise referred to as an optical flow) between frames of 
LIDAR data can be used as input to a GNC processor. This 
operation may be employed in combination with the genera- 
tion of the DEM, as discussed above, for control of a vehicle -, 0 
according to the present invention. 

A method of navigating a vehicle 80 will now be described 
in connection with FIGS. 18-20. 

FIG. 18 illustrates a method 80 for navigating a vehicle. 
The method 80 starts at 82. At step 84, light is emitted from an 25 
emitter 12 to a surface 14. This step is consistent with step 34 
of the method 30 described above. At step 86, light reflected 
from the surface is captured by the array of detectors i that are 
a part of the detector 10 of the flash LIDAR apparatus, the , f) 
details of which are provided above. At step 88, a first frame 
of flash LIDAR data is generated from the first reflected light. 
The first frame of flash LIDAR is made up of a first array of 
range data R ( „ ); as discussed above. The first array of range 
data R ( , ; )i, corresponds to a first array of distances from the 35 
array of detectors i to a corresponding first set of surface 
coordinates At step 90, an elevation map is selected with 
a mesh 0 defining a plurality of cells k. Consistent with the 
method 30, the mesh 0 is envisioned to be a an array of 

J 40 

1 024x1 024 pixels . At step 92, the first array of range data R ( „ „■ 
is projected onto the mesh, thereby generating a first projec- 
tion array. 

Block 94 designates a transition A from FIG. 18 to FIG. 19. 

At step 96, after a predetermined time interval, a second 45 
emitted laser light is emitted from the flash LIDAR apparatus 
to a second surface. This is the initiation of the generation of 
a second frame of flash LIDAR data. At step 98, a second 
reflected light reflected from the second surface is captured by 
the array of detectors i of the flash LIDAR apparatus. At step 
100, a second frame of flash LIDAR data is generated from 
the second reflected light, the second frame of flash LIDAR 
data being made up of a second array of range data R ( „ +1) ,.. 

Block 102 indicates a transition B from FIG. 19 to FIG. 20. 55 

At step 104, using the previously generated DEM, the 
“predicted value” of the frame may be calculated using a 
vector of state from the previous step. The “vector of state” as 
used herein is the orientation and position of the object of 
interest. In this case, the vector of state from the previous step 60 
is the orientation and position of the flash LIDAR apparatus. 
The value of the vector of state, V, can be determined by 
solving the following equation: 

T(r n , l )-nr n )=R„, l -R„ (7) 65 

where T(V) is the theoretical model of the LIDAR frame, 
which is a function of the vector of state, and where R repre- 
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sents the matrix of the distance of a pixel in the detector to the 
surface. In the case where the change to the vector of state is 
less than about 10%, the following linear approximation 
equation (8) can be solved in step 106a: 

amy, id (8) 

B = —av~ 

T 2 -Ti= R(V 2 , h) - R(Vi, h)xBx ( V 2 - V x ) 

V 2 = V l +(B*B)- i x(T 2 -T l ) 

However, in cases where the change in the vector of state is 
greater than about 10%, the following internal inerative equa- 
tion (9) is applied instead of equation (8) in step 106 b: 

V 2 k =V l +(B + B)- l x(R(V 2 k -\h)-r 2 )Jc=l , . . . A 

r 2 °=v l (9) 

At step 1 08, the DEM is updated using the last frame data and 
new vector of state data. At step 110, the optical offset, among 
other parameters, is provided to a navigation apparatus as 
input for navigational control of the vehicle. The optical 
offset also is referred to as an optical flow, because it identifies 
the change in the field of view of the detector from the first 
frame of LIDAR data to the second frame of LIDAR data. The 
output from the frame is used to construct and restore the 
trajectory of the DEM. The offset may be used, together with 
the range data to calculate variables such as change in vehicle 
attitude, speed, acceleration, etc. As should be apparent to 
those skilled in the art, the offset information may be used to 
generate a bevy of different types of information that may be 
used for the GNC processor and apparatus of a vehicle, spe- 
cifically a spacecraft. 

At step 112, the process can be repeated from step 96 in 
FIG. 19 until a predetermined number of frames is processed. 

Building upon the teachings provided above, the present 
invention also encompasses a method of real time image 
processing and enhancement that is largely independent of 
any particular methodology employed to develop a DEM. 

As should be apparent from the foregoing, the method 30 is 
directed to one contemplated embodiment of a super resolu- 
tion algorithm that was found to be effective in generating a 
DEM of sufficient quality. It is recognized, however, that any 
algorithm mat be employed without departing from the scope 
of the present invention. 

The back-projection technique to construct the DEM pro- 
vides a solution which is a convolution with a residual point 
spread function. This method can improve spatial resolution 
2-3 times as compared to the spatial resolution of a DEM with 
a single frame. Further enhancement of the DEM can be 
obtained by following the process 120 as shown in FIG. 21, 
which can improve the spatial resolution 4-8 times assuming 
a realistic level of noise. At step 122, the 2-D discrete Fourier 
Transform is applied to the DEM data obtained from the back 
projection method. At step 124, a regularized inverse filter 
(deconvolution) is applied to the data obtained from step 122. 
One deconvolution method is disclosed in A. Neumaier, Solv- 
ing Ill-Conditioned and Singular Linear Systems: A Tutorial 
On Regularization, SIAM Review 40 ( 1998 ), 636-666, which 
is incorporated herein by reference in its entirety. At step 126, 
the inverse 2-D discrete Fourier transform is applied to the 
data obtained from step 124. The method is concluded which 
results in a DEM with improved spatial resolution. 
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It is noted that the methods 30 , 80 , 120 of the present 
invention may be employed in circumstances other than those 
sampling terrestrial or extraterrestrial terrains. For example, 
the methods of the present invention may be employed to 
assist craft to dock with one another. In such a case, the 
“terrain” might be a space dock. For example. In still other 
applications, the method of the present invention may be 
employed to assist robotic arms to find specific features on a 
device. For example, the methods of the present invention 
mi gilt be employed where a robot is required to manipulate a 
bolt. The methods of the present invention may be employed 
to assist the robot to find the bolt (or “terrain”) that is the 
object of the specific manipulation that has been pro- 
grammed. 

In keeping with the foregoing discussion, the term 
“vehicle” is intended to encompass a robot, robotic arm, or 
other “vehicle” that requires guidance and control vis-a-vis 
the methods of the present invention. 

While preferred embodiments and example configurations 
of the invention have been herein illustrated, shown and 
described, it is to be appreciated that various changes, rear- 
rangements and modifications may be made therein, without 
departing from the scope of the invention as defined by the 
appended claims. It is intended that the specific embodiments 
and configurations disclosed are illustrative of the preferred 
and best modes for practicing the invention, and should not be 
interpreted as limitations on the scope of the invention as 
defined by the appended claims and it is to be appreciated that 
various changes, rearrangements and modifications may be 
made therein, without departing from the scope of the inven- 
tion as defined by the appended claims. 

What is claimed as new and desired to be secured by 
Letters Patent of the United States is: 

1. A method for enhancing a three dimensional image from 
a plurality of frames of flash LIDAR data, comprising: 

(1) emitting laser light from an emitter of a flash LIDAR 
apparatus to a surface; 

(2) capturing light reflected from the surface by a first 
detector i of the flash LIDAR apparatus; 

(3) generating a frame of flash LIDAR data from the cap- 
tured light, the frame comprising a first distance R, mea- 
sured from the first detector i to a first point on the 
surface S ; ; 

(4) selecting an elevation map with a mesh 0 defining a 
plurality of cells k; 

(5) initializing a first array S(k), a second array M(k), and 
a third array D(k), wherein the first array is associated 
with the surface, the second array is associated with the 
elevation map, and the third array D(k) receives an out- 
put comprising an output elevation map for the mesh 0; 

(6) projecting the surface onto a reference surface Q to 
create a projection, wherein the projection comprises a 
zero elevation level; 

(7) selecting a set of cells from the mesh 0 that overlaps 
with the projection; 

(8) calculating a second distance Rj. from a second point on 
the mesh 0 to the detector, wherein a location of the 
second point corresponds with a location of the first 
point; 

(9) calculating a height h fa between the first point and the 
second point according to the equation 

/z fa =(7?£-i?,)xsin 0„ 

wherein 0, is an angle between the surface and the reference 
surface £2; 


16 

(10) updating the first and second arrays according to the 
equations 

S(k 1 )=S(k i )+h /cl 

5 

Af(fc 1 )+Af(£ 1 )+1; 

(11) after completing the updating for all detectors i in the 
frame of flash LIDAR data, normalizing according to the 
equation 

to 

D(k)=S(k)/M(k) for alii 

thereby calculating the third array D(k); 

(12) repeating steps (6) through (11) for each subsequent 
frame of LIDAR data. 

15 2. The method of claim 1, wherein the first point and the 

second point are a center points that are vertically aligned 
with one another. 

3. The method of claim 2, further comprising the step of: 

(14) determining a vector of state for the flash LIDAR 
20 apparatus according to the following equation 

nUi )-T(V„)=R, nl -R n 

wherein T(V) is a function of the vector of state, wherein the 
first detector comprises a first plurality of pixels having a 
2 5 plurality of first di stances measured from the first plurality of 
pixels to a plurality of first points on the surface S„ wherein 
R„ is a matrix comprising the plurality of first distances, 
wherein the second detector comprises a second plurality of 
pixels having a plurality of second distances measured from 
the second plurality of pixels to a plurality of second points on 
the surface S„ wherein R„ +1 is a matrix comprising the plu- 
rality of second distances. 

4 . The method of claim 3, further comprising the step of: 

(15) solving a linear approximation equation as follows: 

dR{V, h) 

B= dV 

T 2 -Ti = R{V 2 ,h)-R{Vi,h)xBx{V 2 -Vi) 

40 

V 2 = V l +(B + B)~ i x(T 2 -T l ) 

(16) updating the elevation map. 

45 5. The method of claim 4 , further comprising the steps of: 

(17) applying 2-D discrete Fourier transform to the eleva- 
tion map; 

(18) applying regularized inverse filter to the elevation 
map; 

50 (19) applying inverse 2-D discrete Fourier transform to the 

elevation map; 

(20) improving the spatial resolution of the elevation map. 
6. The method of claim 3, further comprising the step of 

(15) solving an internal inerative equation as follows: 

r 2 k =r 1 +(B*B)- l x(R(r 2 k - l ,h)-T 2 ),k=l, ...jv 
r 2 °=v \ 

(16) updating the elevation map. 

60 7. The method of claim 6, further comprising the steps of: 

(17) applying 2-D discrete Fourier transform to the eleva- 
tion map; 

(18) applying regularized inverse filter to the elevation 
map; 

65 (19) applying inverse 2-D discrete Fourier transform to the 

elevation map; 

(20) improving the spatial resolution of the elevation map. 
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8. The method of claim 1, wherein the first distance R, 
comprises a plurality of distances, and the second distance 
comprises a plurality of distances. 

9. The method of claim 1, wherein the first array S(k), the 
second array M(k), and the third array D(k) are initialized by 5 
zeroing the values therein. 

10. The method of claim 1, wherein the plurality of cells k 
define an array of AxB pixels. 

11. The method of claim 10, wherein the array is a square 
array, with A=B . 

12. The method of claim 10, wherein the array is a rectan- 
gular array, with A>B. 

13. The method of claim 1, wherein the range R, is calcu- 
lated according the equation 


R , = 1 
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wherein N, is a number of cells k associated with the first 
detector i. 

14. A method for enhancing a three dimensional image 
from a plurality of frames of flash LIDAR data in real time, 
comprising: 

(1) emitting laser light from an emitter of a flash LIDAR 
apparatus to a surface; 

(2) capturing light reflected from the surface by a first 
detector i of the flash LIDAR apparatus; 

(3) generating a frame of flash LIDAR data from the cap- 
tured light, the frame comprising a first distance R, mea- 
sured from the first detector i to a first point on the 
surface S f ; 

(4) selecting an elevation map with a mesh 0 defining a 

plurality of cells k; 35 

(5) initializing a first array S(k), a second array M(k), and 
a third array D(k), wherein the first array is associated 
with the surface, the second array is associated with the 
elevation map, and the third array D(k) receives an out- 
put comprising an output elevation map for the mesh 0; 

(6) projecting the surface onto a reference surface Q to 
create a projection; 

(7) selecting a set of cells from the mesh 0 that overlaps 
with the projection; 

(8) calculating a second distance Rj. from a second point on 
the mesh 0 to the detector, wherein a location of the 
second point corresponds with a location of the first 
point; 

(9) calculating a height h fe between the first point and the 
second point according to the equation 

h kr( R k~ R i ) xs in e i- 

wherein 0; is an angle between the surface and the reference 
surface £2; 

(10) updating the first and second arrays according to the 

equations 55 

S(k 1 )=S(k 1 )+h kl 


15. The method of claim 14, further comprising the steps of 

(13) providing an avionic device, wherein the third array 

D(k) is provided as input to the avionic device to provide 
guidance, navigation, and control. 

16. The method of claim 15, wherein the avionic device 
comprises a Kalman filter. 

17. The method of claim 16, wherein steps 1 through 12 are 
repeated 30 times within 1 second. 

18. The method of claim 17, wherein the three dimensional 
image is image is enhanced such that a four centimeter object 
can be detected from one kilometer distance with a flash 
LIDAR. 

19. A method for enhancing a three dimensional image 
from a plurality of frames of flash LIDAR data, comprising: 

( 1 ) emitting laser light from an emitter of a flash LIDAR 
apparatus to a surface; 

(2) capturing light reflected from the surface by a first 
detector i of the flash LIDAR apparatus; 

(3) generating a frame of flash LIDAR data from the cap- 
tured light, the frame comprising a first distance R, mea- 
sured from the first detector i to a first point on the 
surface S,; 

(4) selecting an elevation map with a mesh 0 defining a 
plurality of cells k; 

(5) initializing a first array S(k), a second array M(k), and 
a third array D(k), wherein the first array is associated 
with the surface, the second array is associated with the 
elevation map, and the third array D(k) receives an out- 
put comprising an output elevation map for the mesh 0; 

(6) projecting the surface onto a reference surface Q to 
create a projection; 

(7) selecting a set of cells from the mesh 0 that overlaps 
with the projection; 

(8) calculating a second distance R*. from a second point on 
the mesh 0 to the detector, wherein a location of the 
second point corresponds with a location of the first 
point; 

(9) calculating a height k/a between the first point and the 
second point according to the equation 

h kt=( R k~ R ,)xsine„ 

wherein 0, is an angle between the surface and the reference 
surface Q, wherein the range R, is calculated according the 
equation 


R, = 1 



wherein N, is a number of cells k associated with the first 
detector i; 

(10) updating the first and second arrays according to the 
equations 


5A' i ) R (k l )h kl 


M{k 1 )=M{k 1 )+ 1; 

(11) after completing the updating for all detectors i in the 60 
frame of flash LIDAR data, normalizing according to the 
equation 

D(k)=S(k)/M(k) for all k 

thereby calculating the third array D(k); and 65 

(12) repeating steps (6) through (11) fora frame of LIDAR 
data. 


M(k i )=M(k l )+l\ 

(11) after completing the updating for all detectors 1 in the 
frame of flash LIDAR data, normalizing according to the 
equation 

D(k)=S(k)/Mik) for all k 

thereby calculating the third array D(k); 

repeating steps (6) through (11) for each subsequent frame 
of LIDAR data. 
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20. A vehicle that operates according to the method of 
claim 19, and wherein the third array D(k) is provided as input 
to a guidance, navigation, and control processor for naviga- 
tion of the vehicle. 



